An introduction of MMML

CMU MMML course homepage CMU MMML course github CMU MMML course lectures by Prof. Louis-Philippe Morency

1. Main challenges / core areas:

(1) Representation learning

(2) Multimodal translation & mapping

(3) Multimodal alignment

(4) Multimodal fusion

(5) Multimodal pretraining

(6) Co-learning

(7) Missing or imperfect modalities

(8) Knowledge graphs and knowledge bases